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SERVIR and Seasonal Forecasting 


SERVIR is a joint NASA-USAID project to bring Earth observations to use 1n decision-making systems 
in SERVIR hub regions: East Africa, Hindu-Kush Himalaya, and Mekong 


Our project was selected to serve the SERVIR Applied Science Team through development and 
evaluation of downscaled seasonal forecasts for use in impact models to be applied in different SERVIR 
hub regions 


- Stephanie Granger/ Jet Propulsion Laboratory / East Africa Drought and Agricultural Productivity Assessment and 
Prediction System 


- Faisal Hossain / University of Washington/ Karly Warning, Mapping, Post-Disaster Visualization System for Water Resources 
of Low-Lying Deltas of the Hindu Kush-Himalayan Region 


- Juan Valdes / Univ Arizona / Water Resource Projections on Medium Range to Decadal Scales for Selected Basins in Africa 


seasonal Forecasts: Provided by the North American Multimodel Ensemble (NMME) 
- 9 models contributing operationally , ~100 ensembles 
- Precipitation, sea surface temperature, and 2-m air temperature are the only variables across all operational models 


- Hindcast archive covering 1982-2010 
- Available at 1°x1°, Monthly resolution @ IRI (http://iridl.ldeo.columbia.edu/SOURCES/.Models/.NMME/) 


AST members require these seasonal forecasts to be downscaled to daily time scales and higher spatial 
resolution — the classic “downscaling” problem with a few wrinkles: 


- Produced on an operational schedule 
- Available for all months... even in months of low seasonal predictability 
- Approach must be easily adaptable to multiple regions, or preferably treat multiple regions at once 





seasonal Forecasting Challenges 


- Variability in seasonal predictability and model skill 
- Local systematic errors 1n model climatology 


- Non-local/Spatial systematic errors such as misrepresentation of covariant relationships (e.g. SST -forced 
teleconnections) 


- Reliability -> ensembles may be under/over-dispersive leading to unreliable forecasts 


Short (OND) Rain Teleconnections - Precipitation (shaded) and Temperature (contour) 
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Addressing Forecasting Challenges 


Predictability and Model Skill 
¢ Use a multi-model ensemble approach to improve skill 






Quantile-Quantile Bias Correction, NCEP-CFSv1, 27E,-11°S 
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Model Space vs. Observational Space 
¢ Calibration: Correct systematic errors 1n model cl 


climatology 
¢ Mean and/or variance adjustment: Zs 
g=arxxt+b 

¢ Quantile-quantile mapping @.e. CDF-matching): = « 
g = Kopel monet) 1 














¢ Multivariate regression: Correct non-local errors; also 
can be used for spatial downscaling 
¢ CCA/MCA/RDA seeks coupled relationships 
between model forecasts and model observations: 
G=A*xX 


Reliability 
¢ Re-calibration: Adjust ensemble members such that they are statistically indistinguishable from 
the observations 


Gij =A* pt Pp *e;; 


Model adjustments — Limitations and Advantages 
Q-Q@ Mapping / Bias Correction 


¢ Rank-preserving transformation, (-) thus unable to improve the probabilistic skill (e.g. as measured 
by RPSS), (+) does not destroy the skill either 
¢ Local, (-) thus unable to correct systematic errors in covariant relationships, (+) easy to apply globally 


Given the ease of application and its ability to maintain skill, we have used Q-Q@ Mapping as part of 
a BCSD (bias correction and statistical disaggregation) approach to generate our Version-1 


downscaled seasonal forecasts for the SERVIR AST 
Available via chirps.nsstc.nasa.govu 





Multivariate Regression 
¢ Non-local, (Own potentially improve predictive skill of forecasts through inclusion of additional 





information, (-)\typically many more predictors than samples to train (e.g. all tropical ocean SST grid 
points) 

¢ State-dependent, (+) uses paired hindcast information to establish relationships and implement time- 
dependent regression estimates, mall hindcasts (~80yrs) limit number of conditional states, (-) some 
states simply dant have m sisnal/predictability (at least in a linear sense) 
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¢ Both of these issues introduce 
classic problems in regression that | Ail | ty 
can lead to overfitting and poor | 
performance of regression 
estimates 
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Multivariate Correction — Formulation and Issues 


X-=~AxF+E X, observation anomaly; F, raw forecast anomaly; E, random error 
Y=AxF X, predicted anomaly 
A= Cy-C re A, Least squares regression coefficient matrix; 


Cyr, covariance between raw forecast and observations; Formalism can be used for different 
Crp , raw forecast covariance matrix multivariate techniques (e.g. CCA, 


MCA, RDA, PPA) 





A=PyS Qi Following Tippett et al. (2008) 
Py, projection pattern into observational space 
S, diagonal (scaling) matrix, (e.g. canonical correlations) 
Q; , projection pattern for raw forecast space 


Particularly for seasonal forecasting, problems of multiplicity & multicollinearity must be addressed. 


¢ The general approach is to operate in a significantly reduced subspace through limitation of the coupled 
patterns included in regression. 
¢ Consequently, a much reduced fraction of variance may be able to be successfully recovered 


RDA RDA Mode 1, CHIRPS Rainfall (mm/day) Predictand, Valid: Nov, Lead: 0.5 
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RDA Mode 1,NMME Rain (mm/day) Predictor, Valid: Nov, Lead: 0.5 








Multivariate Correction as a “Replacement” prediction 


¢ Where the loading patterns in observations are small, MVR will tend to produce near-climatological 
predictions. 


¢ While this is preferable in an area where there is low-skill in the context of the MVR, it is possible 
that you are removing skill that WAS present in the raw seasonal forecasts. 


X = Fraw 


X = PyS(QrF raw) 
¢ This problem is compounded in particular by the necessity to use a very reduced set of modes that 
may or may not project strongly, or recover a significant amount of variability, in your region of 
interest. 


¢ Thus we are left with the challenge of understanding how to blend the good with the bad. That is how 
can we work towards correcting the systematic (nonlocal) errors when we can robustly identify them 
while at the same time not destroying the potential skill found in the raw seasonal forecast. 





Multivariate Correction as an “Error Replacement” prediction 


¢ Rather than focusing on the structure of the relationship between observations and the model forecast, we can 
instead focus on the structure of errors 1n forecast. 


X(t) = F,(€) + Aj(t) i, index for forecast ensemble member 
A;(t) = X(t) — F,(@) 
¢ Seek a multivariate regression estimate of the error field to be used for “correcting” the error 1n a state/time- 
dependent manner 


a(t) = A* F,(t) + E() F(t), set of predictors from available 
forecasts 


Aj(t) = A * F(t) 
X,(0) = F,(t) + A* Fi) 


¢ Where the loading patterns in observations are small, the predicted error correction should tend towards 
“climatology,” or near-zero values such that the final prediction tends towards the original model prediction 


¢ Further, you could potentially severely restrict the correction factor by thresholding the projection coefficients 
so that corrections are only implemented when your model projects strongly onto the projection pattern (in 
forecast space) that is coupled to some well-associated error pattern 


¢ In short, this rearrangement is more of an effort to use the hindcasts to identify predictable error patterns 
themselves, and then remove them when we expect them to be present. 





Results 


Anomaly Correlation, East Africa, OND Seasonal Precipitation, CFSv2(7=1.5), 
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¢ The new MVR strategy generally out-performs the traditional “replacement” approach 
¢ It does primarily but hedging more closely to the raw forecast prediction 


¢ However, the new approach still shows only limited improvement, for this model, 
season, and lead time, over the raw forecast 





Summary 


As with long-term climate projections, bias correction and downscaling — either statistical or 
dynamical — is a necessity for seasonal climate forecasts for those using impact models 


Bias correction involves both calibration of systematic errors 1n the model climatology as well 
as recalibration of ensemble forecasts to ensure reliability 


Calibration can be (and has) been implemented in a variety of ways 
¢ simple linear scaling and shifting, 
¢ full distribution-matching (i.e. Quantile-quantile mapping) 
¢ Multivariate correction using some form of multivariate regression 


Multivariate correction is typically implemented in a “replacement” approach. Because of the 
need to significantly truncate the space in which the regression is performed, with a 
complementary loss of variance, MVR approaches often result in near-climatological, low-skill 
predictions even though the original model forecasts may have shown some non-negligible skill 


We have implemented a new approach to the correction in which we attempt to estimate the 
systematic error component outright and then “adjust” the model forecast to account for the 
predicted error component. 


The new approach tends to outperform the MVR-“replacement” approach. However, it does not 
necessarily outperform the raw predictions skillful models. 





